- 1 - 



CFO 10252 US 



Video System 



BACKGROUND OF THE IhfVENTIQN 
Field of the Invention 
5 5^^^ The invention relates to a video system suitable 
for use in a teleconference or the like using an image 
through a multimedia network. 
Related Background Art 

In recent years, a television conferencing system 
10 has been widespread due to a spread of high speed 
IS digital lines. As a typical construction of the 

m 

pj conventional television conferencing system, there is a 

kQ representative system such that exclusive-use terminals 

Q each comprising a video camera for displaying the face 

lU 15 of a speaker and a video monitor are installed at two 
J5 or more locations and the terminals are connected by 

'-^ lines of N-ISDN or the like. 

However, even if an exclusive-use video monitor is 
not used, moving images can be displayed on 
20 multiwindows owing to the recent realization of a high 
performance of a personal computer or a workstation. 
Therefore, a teleconference using moving images and 
voice sounds (hereinafter, the conference of such a 
style is referred to as a multimedia teleconference) is 
25 being put into practical use by using personal 

computers and workstations which are connected by a 
network. A calligraphic and pictorial camera to 
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photograph not only the face of a partner of the 
conference but also a document or solid object is also 
used. 

Moving images and voice sounds are used in the 
5 teleconference because of the introduction of the 
multimedia teleconferencing system, so that a 
communication of a higher quality is realized* 
However, in order to see a portion or the like which is 
P Q not displayed on a display apparatus on operator 

."■'-4 ^ 10 side, a message indicating thatToperator wants to see 

m 'y 

W\ such a hidden portion is informed to the partner side 



Hi 



each time so as to operate the camera on the partner 
side. There is consequently a problem such that both 

/3 o'^^x^SPS are troublesome and the conference is 

15 interrupted or the like. 

SUMMARY OF THE I NVENTION 

It is an object of the present invention to 
provide a video system with a high use efficiency and a 
20 high performance. 

Another object of the invention is to provide an 
image pickup control apparatus which can photograph a 
video image with a high picture quality. 

Still another object of the invention is to 
25 provide a camera corresponding to a video system of a 
high performance. 

To accomplish the above objects, according to an 



embodiment of the present invention, control means for 
controlling a camera is connected to the camera by 
communicating means, an image pickup state of the 
camera is set on a screen of display means for 
displaying a video signal which is generated from the 
camera, and the camera is controlled so as to 
photograph an object in the set image pickup state. By 
using the above construction, there is an effect such 
that the image pickup state of the camera existing at a 
remote position can be easily controlled. 

According to another embodiment of the invention, 
control means for controlling a camera is connected to 
the camera by communicating means, an image pickup 
state of the camera is set on a screen of display means 
for displaying a video signal which is generated from 
the camera, and the set image pickup state is stored. 
By using the above construction, there is an effect 
such that the image, pickup state of the camera existing 
at a remote position can be-^eoa changed as necessary, 
A, According to -^^z UPth o r - another embodiment of the 

invention, control means for controlling a camera is 
connected to the camera by communicating means, a range 
on a screen of display means for displaying a video 
signal which is generated from the camera is 
designated, and an image pickup state of the camera is 
changed for the designated range. By using the above 
construction, there is an effect such that the image 
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pickup state of the camera existing at a remote 
position can be changed for a necessary range on the 
screen and a video image of a higher picture quality 
can be obtained. 
5 G> According to -#w%faea? another embodiment of the 

invention, when image pickup means of a csunera converts 
an optical image into a video signal, its image pickup 
state is changed in accordance with an input from an 
p external apparatus. By using the above construction, 

^^j 10 there is an effect such that the image pickup state of 

IB 

jn the camera can be controlled from a remote position. 

|ij 

g According to further another embodiment of the 

i . ^ . 

invention, an apparatus has an image pickup element for 

If converting a light to an electric signal, an image 

5^ 15 signal photographed by image pickup means which is 

S controlled by an external input is displayed by image 

display means having a multiwindow display function 

through communicating means, a display screen of the 

display means is instructed and inputted by a pointing 

20 device, and a panning control of a desired image pickup 

apparatus is executed through communicating means. By 

using the above construction, there is an effect such 

that the panning control of the image pickup means 

existing at a remote position can be easily and 

25 certainly executed. 

PL p-Cir/A^r 

\S According to f^ar'Cher ane^fe^tea?' embodiment of the 

invention, ah apparatus has an image pickup element for 



m 
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O converting ^ light to an image signal, an image signal 
obtained by photographing an object by image pickup 
means whose operation is controlled by an external 
input is displayed on image display means having a 
multiwindow display function through communicating 
means, a display surface of the display means is 
designated by a pointing device, and a focal distance 
and a direction of desired image pickup means are 
controlled through communicating means so that a field 



10 angle of the designated region coincides with a display 

in 

111 



image. By using the above construction, there is an 
effect such that the focal distance and direction of 
the image pickup means existing at a remote position 
can be easily and certainly controlled. 



15 jf3 According to -^^L^ 



According to -^^d-a=^^^ef another embodiment of the 
A 

invention, an apparatus has an image- pickup element for 
^ converting light to an image signal, an image signal 
obtained by photographing an object by image pickup 
means whose operation is controlled by an external 

20 input is displayed by image display means having a 
multiwindow display function through communicating 
means, a display surface of the display means is 
designated by a pointing device, and an exposure amount 
of desired image pickup means is controlled through the 

25 communicating means so that a display image of the 

designated region has an optimum exposure amount. By 
using the above construction, there is an effect such 



that: the exposure amount of the image pickup means 
existing at a remote position can be easily and 
certainly controlled . 



invention, an apparatus has an image pickup element for 
converting a light to an electric signal, an image 
signal obtained by photographing an object by image 
pickup means whose white balance is controlled by an 
external input is displayed by image display means 
having a multiwindow display function through 
communicating means, and a white balance of desired 
image pickup means is controlled through the 
communicating means so that the image is displayed in 
white. By using the above construction, there is an 
effect such that the white balance of the image pickup 
means existing at a remote position can be easily and 
certainly controlled. ^ . 



According to ^f^«*%he'g— a not her embodiment of the 
invention, an apparatus has an image pickup element for 
converting a light to an electric signal, an image 
signal obtained by photographing an object by image 
pickup means whose focus is automatically controlled by 
an external input is displayed through communicating 
means by image display means having a multiwindow 
display function, a display screen of the display means 
is designated by a pointing device, and a desired 
automatic focusing control is executed for the 



According to 




of the 



A 
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designated region through the conununicating means. By 
using the above construction, there is an effect such 
that the automatic focusing control of the image pickup 
means existing at a remote position can be easily and 
certainly executed. 

The above and other objects and features of the 
present invention will become apparent from the 
following detailed description and the appended claims 
with reference to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a whole 

construction of an embodiment of the present inventions- 
Fig. 2 is a block diagram showing a constructional 

example of a terminal station A and a camera A-1; 

Fig. 3 is a block diagram showing a processing 

flow of a signal processing circuit 110; 

Fig. 4 is a block diagram showing a processing 

flow of a signal processing circuit 119; 

Fig. 5 is an explanatory diagram of a display 

screen of a terminal station A: 

Fig. 6 is an explanatory diagram of each section 

of a camera control menu 205 and a display window 201; 
Fig. 7 is a diagram showing a part of a flow of a 

multimedia teleconference according to an embodiment; 

Figs. 8A to 8E are diagrams for explaining a user 

interface of a panning control in the embodiment; 
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Figs. 9A to 9E are explanatory diagrams about a 
zooming control in the embodiment; 

Figs. lOA to lOD . are diagrams showing the user 
interface when an exposure level of an image of an 
arbitrary designated range is set to a proper valued- 
Figs. IIA to IID are diagrams showing the user 
interface when a focus is positioned to an object of an 
arbitrary designated range in the embodiment; 

Figs. 12A to 12D are diagrams showing the user 
interface when a white balance is attained on the basis 
of image information of an arbitrary designated range 
in the embodiment; 

Figs. 13A to 13D are diagrams showing a memory 
function of a field angle setting and the user 
interface 
in the embodiment; 

Fig. 14 is a diagram showing a display example 
when a memory funct.ion of the setting and a reduction 
image is applied to a hierarchy menu of an AE menu; 

Figs. 15A to 15C are diagrams for explaining the 
user interface when the setting of a camera A-2 is 
fixed for a predetermined time; and 

Fig. 16 is a diagram showing a control flow to 
authorize to control a camera. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



Fig. 1 is a schematic diagram showing an example 



of a whole construction of the invention. 

In Fig. 1, reference numeral 1 denotes a first 
terminal station which is used in a multimedia 
teleconference and it is simply called a terminal A. 
Actually, it is not always necessary to use the 
terminal only for the multimedia teleconference but a 
personal computer or a workstation which has a bit map 
display and can display in multiwindows is used as a 
terminal • Reference numeral 2 denotes a camera for 
mainly photographing the face of a person and such a 
camera is hereinafter referred to as a camera A-1. 
Reference numeral 3 denotes a tripod to control the 
direction of the camera A-1; 4 indicates a calligraphic 
and pictorial camera for photographing an original, a 
printed matter, a solid object, or the like and such a 
camera is hereinafter referred to as a camera A-2; 5 
indicates a movable arm for changing a photographing 
region of the camera A-2, 

In a manner similar to the above, reference 
numeral 6 denotes a second terminal station B; 7 a 
camera B-1 connected to the terminal B; 8a tripod of 
the camera B-1; 9 a calligraphic and pictorial camera 
which is connected to the terminal B and such a camera 
is hereinafter referred to as a camera B-2; 10 a 
movable arm of the camera B-2; 11 a third terminal 
station C; 12 a camera which is connected to the 
terminal C and such a camera is hereinafter referred to 
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as a camera C-1; 13 a tripod of the camera C-1; 14 a 
calligraphic and pictorial camera which is connected to 
the terminal C and such a camera is hereinafter 
referred to as a camera C-2; and 15 a movable arm of 
the camera C-2. 

The image pickup region of each camera is 
controlled from each terminal by the tripods 3, 8, and 
13 and the movable arms 5, 10, and 15. Reference 
numeral 16 denotes a network to connect the terminal 
stations and 17 indicates a server to manage the 
multimedia teleconferencing system. As for an image of 
each camera, one window is allocated to one camera and 
those images are displayed in multiwindows of the 
display of each terminal. 

Fig. 2 is a block diagram showing a constructional 
example of the terminal A and the camera A-1. It is 
assumed that the other cameras also have a similar 
construction unless otherwise specified in the 
following description and the component elements having 
the same functions are designated by the same reference 
numerals . 

In Fig. 2, reference numeral 101 denotes a lens; 
102 a lens driving unit for performing a focusing 
adjustment of the lens and a zooming; 103 an iris; 104 
an iris driving unit; 105 a solid-state image pickup 
element for converting an optical image projected by 
the lens 101 to an electric signal; 106 a solid-state 



image pickup element driving circuit for driving the 
solid-state image pickup element 105; 107 an A/D ' 
converter for A/D converting an output of the solid- 
state image pickup element 105; 108 a memory for 
temporarily storing the A/D converted image data; 109 
an encoding circuit for compressing and encoding the 
image data which was temporarily stored in the memory 
108; 110 a signal processing circuit for performing 
signal processes such as color separation, white 
balance correction, color conversion, frequency band 
limitation, outline correction, and the like of the 
image data stored temporarily in the memory 108; 111 a 
data bus to access the digital data in the memory 108 
by the compressing circuit 109 and signal processing 
circuit 110; 112 a system control circuit for 
controlling the operation of the camera system; and 11 
a tripod driving unit for driving the tripod 3 of the 
camera A-1. It is now assumed that in case of the 
calligraphic and pictorial camera like a camera A-2, 
the tripod driving unit 113 drives the movable arm 5. 
Reference numeral 114 denotes an external interface 
circuit for transmitting digital image data from the 
camera A-1 to the terminal A and for transmitting 
control parameters from the terminal A to the camera A 
1. The camera A-1 is constructed by the above 
component elements. 

Reference numeral 115 denotes a first external 



interface circuit of the terminal A. The I/F circuit 

115 is connected to the camera A-1. Reference numeral 

116 denotes a second external interface circuit of the 
terminal A. The I/F circuit 116 is connected to the 
camera A-2. Reference numeral 117 denotes a memory to 
temporarily store digital image data from a network; 
118 a decoding' circuit for expanding and decoding the 
image data sent from the network and camera as data 
compressed and encoded data; 119 a signal processing 
circuit for performing processes such as color 
conversion and gradation correction to the image data 
which has been decoded and stored temporarily in the 
memory 117; and 120 a D/A converter for D/A converting 
the signal which was processed by the signal processing 
circuit 119. 

Reference numeral 121 denotes a data bus to access 
the digital data in the memory 117; 122 a system 
control circuit to control the operation of the 
terminal A; 123 a pointing device such as a mouse or 
the like; 127 a button of the pointing device 123; 124 
a pointing device interface as an interface between the 
pointing device 123 and the system control circuit 122; 
125 a network interface circuit for connecting the 
network and the terminal A; and 126 a monitor to 
display an image or data. The terminal A is 
constructed by the above component elements • 

Fig. 3 is a block diagram showing a processing 




flow of the signal processing circuit 110. 

In Fig, 3, reference numeral 501 denotes a block, 
of a color separation to extract signals corresponding 
to R, G, and B from an output of the solid-state image 
pickup element 105; 502 a block of a white balance to 
adjust a gain balance among the signal levels so that 
ratios of R, and B of a white portion of an object 
are set to 1:1:1; 503 a block of a color conversion 
to convert the RGB signals to a luminance and color 
difference signals of a good compressing efficiency; 
504 a block of a frequency band limitation to limit 
unnecessary frequency bands; and 505 a block of an 
outline correction to improve a resolution feeling. 

Fig. 4 is a block diagram showing a processing 
flow of the signal processing circuit 119. Reference 
numeiral 506 denotes a block of a color conversion to 
convert the luminance and color difference signals to 
the RGB signals; and 507 a gradation correction block 
to match with gradation characteristics of the monitor 
126. 

The operation of the terminal A will now be 
described . 

In Fig. 2, image data from another terminal which 
is transmitted from the network 16 and a control 
command and parameters of the camera are supplied to 
the system control circuit 122 through the network 
interface circuit 125. 
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The image data from the network 16 and the image 
data from the camera A-1 or A-2 are stored into the 
memory 117 through the data bus 121. If the control 
command and parameters of the camera relate to the 
control of the camera A-1, they are supplied to the 
camera A-1 through the external interface circuit 115. 
If they relate to the control of the camera A-2, they 
are sent to the camera A-2 via the external interface 
circuit 116. The image data stored in the memory 117 
is expanded and decoded by the decoding circuit 118 and 
is processed by the signal processing circuit 119. 
After that, the signal is D/A converted and the 
resultant analog signal is displayed on the monitor 
126. 

The operation of the camera A-1 will now be 
described. 

The object is projected to the solid-state image 
pickup element 105 by the lens 101. In this instance, 
the focusing adjustment and the field angle adjustment 
are controlled by the system control circuit 112 
through the lens driving unit 102. A light amount is 
controlled by the system control circuit 112 via the 
iris driving unit 104. The direction of the camera A-1 
is controlled by the system control circuit 112 through 
the tripod driving unit 113. An output of the solid- 
state image pickup element 105 is converted to digital 
data by the A/D converter 107 and is once stored into 
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the memory 108. The output data of the solid-state 
image pickup element 105 stored in the memory 108 is 
subjected to processes such as color separation, white 
balance, color conversion, frequency band limitation, 
and outline correction by the signal processing circuit 
110. The processed image data is compressed and 
encoded by the encoding circuit 109 and is transmitted 
to the terminal A through the external interface 
circuit 114. 

The image data sent to the terminal A is displayed 
on a window of the monitor 126 of the terminal A in a 
manner similar to that mentioned above and is also 
transmitted to the network 16. The control command and 
parameters of the camera A-1 are interpreted by the 
system control circuit 112, thereby performing the 
focusing control, iris control, white balance, tripod 
control, and the like. Since the controllable items 
and the possible range of the parameters differ in 
dependence on each camera, the items which can be 
controlled by the camera, the possible range of the 
parameters, and the present values of the parameters 
are supplied from the system control circuit 112 to the 
terminal A in accordance with an inquiry from the 
terminal A. They are further supplied to the server 17 
through the network 16. 

Fig. 5 is an explanatory diagram of a display 
screen of the terminal A, 
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In Fig, 5, reference numeral 201 denotes a display 
window of the camera A-1; 202 a display window of the 
camera A-2; 203 a display window of the camera B-1; 204 
a display window of the camera B-2; and 205 a camera 
control menu. 

Fig. 6 is an explanatory diagram of each section 
of the camera control menu 205 and display window 201 . 

Reference numeral 301 denotes a cursor indicative 
of the position designated by the pointing device; 302 
a vertical panning bar as a rectangular region to 
display a user interface for controlling a panning in 
the vertical direction of the camera; 303 an upward 
panning button which is used when panning upward; 304 a 
downward panning button which is used when panning 
downward; and 305 a region called a thumb which is 
designated by pressing the button 127 of the pointing 
device 123. By vertically moving the cursor 301, the 
vertical panning operation of the camera can be 
executed . 

The operation to move the cursor 301 with the 
button 127 of the pointing device 123 depressed as 
mentioned above is generally called "drag" and this 
terminology will be used hereinbelow. The operation 
such that the button 127 of the pointing device 123 is 
pressed and is soon released is generally called 
"click" and this terminology will be used hereinbelow. 

Reference numeral 306 denotes a horizontal panning 



bar as a rectangular region to display a user interface 

to control the horizontal panning of the camera; 307 a 

leftward panning button which is used when panning 

leftward; 308 a rightward panning button which is used 

5 when panning rightward; and 309 a thumb of the 

horizontal panning bar 306. 

Reference numeral 310 denotes a zoom bar as a 

rectangular region to display a user interface for 

U controlling a field angle; 311 a ^*ete button which is 
(3 ^ /I 

10 used when the camera is zoomed in; 316 a wide button 

which is used when the camera is zoomed out; and 313 a 

in 

ry thumb of the zoom bar 310. 

Reference numeral 312 indicates a rectangular 
O region which is used for display or the like of the 

m 

ry 15 name of the display window and is called a title bar; 



315 a name of a display window and it is assumed in the 
embodiment that an identification name of the camera is 
displayed; and 314 a status display region of the 
camera . 

20 Reference numeral 408 indicates a movement bar as 

a rectangular region which is used when moving the 
camera control menu 205; 401 a Lock menu; 402 an AE 
menu; 403 an AF menu; 404 an AWB menu; and 405 an Angle 
menu. Functions of the above menus will be described 

25 /3 hereinbelow. Reference numeral 406 denotes a C onf iq 

menu which is used to set other items and 407 indicates 
a hierarchy menu button which is displayed in the case 
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where the functions which are further classified as a 
hierarchy exist in the lower layer. By clicking the 
hierarchy menu button 407, the menu of the lower layer 
is displayed. The hierarchy menu button 407 is 
displayed in all of the menus having the hierarchy 
menu . 

Fig. 7 is a diagram showing a part of a flow of 
the multimedia teleconference in the embodiment. 

A server to manage the conferencing system first 
inquires the controllable items and parameters of each 
camera connected to each terminal, the possible range 
of the parameters, and the present values thereof (step 
SI): Each camera receives this inquiry through the 
terminal and responds to the inquiry. If the camera 
ooesa-^ have a responding ability, the terminal 

h 

substitutionally responds. The server forms a table of 
the specification and initial status of the camera by 
the response information (S2 to S4 ) . The display 
window 201 and camera control menu 205 are displayed on 
each terminal on the basis of the information of the 
table (S5). In this instance, a user interface for 
controlling according to the specification of each 
camera is displayed in the display window of each 
camera . 

In the example shown in Fig. 5, as a result of the 
inquiry to the camera B-1, it is found out that the 
functions of zoom and panning cannot be used. 



Therefore, the vertical panning bar 302, horizontal 
panning bar 306, and zoom bar 310 are not displayed in 
the display window of the camera B-1. The aspect ratio 
of the camera is reflected to the shape of the display 
5 window. When the aspect ratio of the camera is equal 
to 4 : 3, the aspect ratio of the display window is 
equal to 4 : 3. When the aspect ratio of the camera is 
equal to 16 : 9, the aspect ratio of the display window 
is equal to 16 : 9. When the display window of the 

10 camera is displayed, the multimedia teleconference is 
started and the processing routine enters a loop to 
watch an event from each participant. If the 
participant does nothing, the watching of the event is 
continued (S6). 

15 In the case where an event such as selection or 

the like of a menu by the participant is detected, the 
event is analyzed (37), If the event indicates the 
item regarding the control of the camera, a control 
message is sent to the camera (S8, S9 ) . In case of the 

20 other item, the processing corresponding to it is 

executed (SIO). In case of a message such as to change 
a condition of the camera, the camera analyzes the 
message and changes in a possible range. After that, a 
new condition is informed as a message to the server. 

25 The server changes a camera condition table by the 
message of the camera and changes the state of the 
display window of each terminal and the camera control 
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menu (Sll). The processing routine advances to an 
event loop to again perform the watching operation of 
the event. 

The control operation and display for the camera 
image pickup operation will now be practically 
explained with reference to the description of the name 
of each section of the screen displays shown in Figs . 5 
and 6 and explanatory diagrams of the operations of 
Fig. 8A and subsequent diagrams. 

Figs. 8A to 8E are diagrams for explaining with 
respect to a user interface of the panning control in 
the embodiment- For example. Figs. 8A to 8E show a 
case of performing the panning of the camera A-2. 

As shown in Fig. 8A, when the title bar 312 of the 
display window of the camera A-2 is designated and 
clicked by the pointing device 123, the camera A-2 can 
be controlled. In this instance, the color of the 
title bar 312 changes as shown in Fig. 8B, thereby 
indicating that the camera A-2 becomes controllable. 

The positions of the thumbs 305, 309, and 313 in 
the panning bars 302 and 306 and zoom bar 310 are 
determined on the basis of a specification table and a 
status table of the camera A-2 formed by the server 17. 

Fig, 8B shows a method of controlling the vertical 
panning of the camera A-2. When the downward panning 
button 304 of the vertical panning bar 302 of the 
camera A-2 is designated and clicked or when the thumb 
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305 is designated and is dragged downward, the movable 
arm 5 of the camera A-2 operates, thereby panning the 
camera A-2 downward. In this instance, the panning 
operation is performed for a period of time during 
which the button 127 of the pointing device 123 is 
depressed. When the button is released, the panning 
operation is stopped. 

On the contrary, when the upward panning button 
303 of the vertical panning bar 302 is designated and 
is kept clicked or when the thumb 305 is designated and 
is dragged upward as shown in Fig. 8C, the movable arm 
5 of the camera A-2 operates, thereby panning the 
camera A-2 upward. 

When the rightward panning button 308 of the 
horizontal panning bar 306 is designated and clicked or 
when the thumb 309 is designated and dragged rightward 
as shown in Fig. BD, the movable arm 5 of the camera A- 
2 operates, thereby panning the camera A-2 rightward. 
On the contrary, when the leftward panning button 307 
of the horizontal panning bar 306 is designated and 
clicked or when the thumb 309 is designated and dragged 
leftward as shown in Fig. BE, the movable arm 5 of the 
camera A-2 operates, thereby panning the camera A-2 
leftward. 

In general, there is a scroll bar to scroll a 
document by an application software of a word processor 
using the multiwindow or the like. However, as shown 
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in the embodiment:, the user interface for controlling 
the panning is arranged at the same position as that of 
the scroll bar of the document, so that a desired 
portion of an object existing at a remote position can 
be seen by an operating method similar to that of the 
scroll of the document. 

Figs. 9A to 9E are explanatory diagrams regarding 
the zooming control in the embodiment . 

As shown in Fig. 9A, by designating and clicking 
the title bar 312, the camera A-2 becomes controllable. 
In this instance, as shown in Fig. 9B, the color of the 
title bar 312 is changed, thereby indicating that the 
camera A-2 is in a controllable state. Subsequently, 
as shown in Fig. 9B, when the tele button 311 of the 
zoom bar 310 of the camera A-2 is designated and 
clicked or "when the thumb 313 is designated upward and 
dragged, the camera A-2 is zoomed in by the lens 
driving unit of the camera A-2. In this instance, 
while the button 127 of the pointing device 123 is 
pressed, the zooming operation is performed. When the 
button is released, the zooming operation is stopped. 
On the contrary, as shown in Fig. 9C, when the wide 
button 316 of the zoom bar 310 is designated and 
clicked or when the thumb 313 is designated and dragged 
downward, the camera A-2 is zoomed out by the lens 
driving unit 102 of the camera A-2. 

Fig. go shows a user interface when the panning 



and zooming of the camera A-2 are simultaneously 
controlled to thereby control a field angle. 

As shown in Fig. 9D, when a desired field angle 
range is designated by dragging the pointing device 123 
from the left upper vertex of a desired field angle to 
the right lower vertex of the desired field angle, the 
designated field angle range is displayed by a broken 
line 601. When the Angle menu 405 of the camera 
control menu 205 is clicked in this state, the lens 
dr±\/±ng unit 102 and the movable arm driving unit 113 
of the camera A-2 are controlled. The camera A-2 is 
controlled so as to obtain the designated field angle 
and a display is performed as shown in Fig. 9E. 

Figs. lOA to lOD are diagrams showing a user 
interface when an exposure level of an image of an 
arbitrary designated range is set to a proper value. 

Fig. lOA shows a state in which although the 
camera A-1 photographs two persons, a state of the 
illumination is bad and the right half of the screen is 
too dark and the left half is too light, so that both 
of the exposure levels of two persons are not set to 
the proper levels. In this state, the display window 
of the camera A-1 is clicked by the pointing device, 
thereby setting the camera into the controllable state. 
When a screen range which should be set into a proper 
exposing state is designated and dragged by the 
pointing device as shown in Fig. lOB, a designated 



rectangular region 602 is displayed by a broken line. 

As shown in Fig. IOC, when the AE menu 402 is 
designated and clicked, both of designated range 
information instructing to provide a proper exposure 
and a message to set the exposure level in the 
designated range to a proper level are sent to the 
camera A-1 through the server 17. The system control 
circuit 112 of the camera A-1 controls the iris 103 
through the iris driving unit 104 so as to set the 
image data in the designated rectangular region to a 
proper level. Thus, as shown in Fig. lOD, the exposure 
level of the camera A-1 is controlled and the 
designated range is set to the proper exposure level . 
The designated range information of the optimum 
exposure level in the camera condition table of the 
server 17 is changed as set in the camera A-1. 

Figs. IIA to IID are diagrams showing a user 
interface when the camera is focused on an object in an 
arbitrary designated range in the embodiment. 

Fig. IIA shows a display screen in the case where 
two persons were photographed by the camera A-1. 
However, since the focusing information is generally 
obtained by the image data near the center of the 
screen, if an object like a calendar exists at the 
center of the screen as shown in the diagram, the 
camera is focused on the calendar and is not focused on 
the persons. In such a case, by designating and 



clicking the title bar 312 of the display window of the 
camera A-1, the camera A-1 becomes controllable. 
Subsequently, as shown in Fig. IIB, when the screen 
range to be focused is designated and dragged by the 
pointing device, a designated rectangular region 603 is 
displayed by a broken line. 

As shown in Fig. IIC, when an AF menu is clicked, 
both of focusing range designation information and a 
message instructing to focus on the designated focusing 
range are sent to the camera A-1 through the server 17. 
The system control circuit 112 of the camera A-1 
performs a focusing adjustment of the lens 101 through 
the lens driving unit 102 so as to maximize a sharpness 
degree of the image in the designated focusing range on 
the basis of the focusing range designation 
information, thereby focusing on the designated persons 
as shown in Fig. IID. The designated range information 
of the focusing range in the camera condition table of 
the server 17 is also changed as set in the camera A-1. 

Figs. 12A to 12D are diagrams showing a user 
interface when a white balance is attained on the basis 
of the image information in an arbitrary designated 
range in the embodiment. 

Fig. 12A shows a state in which since the color of 
the wall is extremely deep, a white balance cannot be 
attained according to the average color information of 
the screen. In such a case, the title bar of the 
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display window of the camera A-1 is designated and 
clicked by the pointing device, thereby making the 
camera A-1 controllable. Subsequently, as shown in 
Fig. 12B, when a rectangular region which is expected 
to be white is dragged and designated, a rectangular 
region 604 is displayed by a broken line. As shown in 
Fig. 12C; when the AWB menu 405 is designated and 
clicked, both of the coordinate information of the 
rectangular region 604 and a message instructing to 
attain a white balance on the basis of the image 
information in the rectangular region are sent to the 
camera A-1 through the server 17, The system control 
circuit 112 of the camera A-1 controls so as to attain 
a white balance by the white balance processing 502 
from the image information corresponding to the 
rectangular region 604. By the above operation, the 
white balance of the camera A-1 is attained by the 
image information of the designated range. The 
designated range information of the white balance in 
the camera condition table of the server 17 is also 
changed as set in the camera A-1. 

Figs. 13A to 13D are diagrams showing a memory 
function of the field angle setting and its user 
interface in the embodiment. 

It is now assumed that the camera A- 2 has been set 
to a field angle as shown in Fig. 13A. In the case 
where it is presumed that a frequency of the use of 



such a field angle is large, by clicking the hierarchy 
menu button 407 of the Angle menu 405, a Memorize menu 
409 is displayed. As shown in Fig. 13B, the cursor 301 
of the pointing device 123 is dragged onto the Memorize 
menu 409 and the button 127 of the pointing device 123 
is subsequently released, the field angle set 
information is stored. At the same time, a reduction 
image 410 of the image at the field angle appears at a 
position adjacent to the Memorize menu 409. Each time 
the above operation is repeated, a new reduction image 
is registered at a position adjacent to the Memorize 
menu 409 . 

A method of again setting to the stored field 
angle will now be described. As shown in Fig. 13C, the 
cursor 301 of the pointing device 123 is dragged to the 
position of the registered reduction image indicati.ve 
of the field angle to be set and the button 127 of the 
pointing device 123 is subsequently released- Thus, 
the lens driving unit 102 and movable arm driving unit 
113 of the camera A-2 are controlled as shown in Fig. 
13D and the camera A-2 is controlled so as to have the 
designated field angle. 

Although the description is omitted, the above 
method can be used to store not only the setting of the 
field angle but also the setting of the range to set 
the exposure level to the optimum exposure level 
described in the AE menu, the setting of the focusing 



designated range described in the AF menu, and the 
setting of the range of the white balance described in 
the AWB menu. 

Fig. 14 shows a display example in case of 
applying the memory function of the setting and the 
reduction image to the hierarchical menu of the AE 
menu. Since the field angle is not changed in case of 
the AE menu or the like, in order to allow the setting 
to be easily selected again, the region indicative of 
the set range in the reduction image is displayed in a 
broken line rectangular region 605. 

Figs. 15A to 15C are diagrams for explaining a 
user interface when the setting of the camera A- 2 is 
fixed for a. predetermined time. 

Changes of the set field angle and other settings 
from another terminal can be inhibited for a 
predetermined time. As shown in Fig. 15 A, when the 
title bar 312 of the display window of the camera A-2 
is designated and clicked by the pointing device at the 
terminal the camera A-2 becomes controllable. As 
shown in Fig, 153, subsequently, when the Lock menu 401 
is clicked, the camera is fixed to the present set 
condition of the camera. That is, the control of the 
camera A-2 from another terminal is inhibited. In this 
instance, there is a time limitation in the set fixed 
time and the remaining time is displayed on a residual 
time display window 606. A message indicating that the 
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terminal is in use is displayed in the status display 
region 314 of the window of the camera A-2 at the 
terminals other than the terminal B as shown in Fig, 
15C, 

Fig. 16 shows a control flow of a control 
authorization of the camera. 

When the title bar 312 of the display window of 
the camera A-2 is designated and clicked at the 
terminal B, the terminal B is authorized to control the 
camera A-2 (S31 to S33 ) . Subsequently, the color of 
the title bar 312 of the display window of the camera 
A-2 of the terminal B is changed to a selection state 
(S34). A message indicating that the terminal B is in 
use is displayed in the camera status display region 
314 of the title bar of the display window of the 
camera A-2 other than the terminal B (S35). When an 
event occurs within a predetermined time, the event is 
analyzed (S36, S37). When no event occurs within the 
predetermined time, it is released to authorize the 
terminal B to control the camera A-2 (S36, S38 ) . When 
it is judged by the event analysis that the Lock menu 
401 has been selected, the control of the camera A-2 
from another terminal is inhibited for a predetermined 
time and a residual time to fix the setting of the 
camera A-2 is displayed in the residual time display 
window 606 at the terminal B (S37, S39, S40 ) . After 
the elapse of a predetermined time, it is released to 
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authorize the terminal B to control the camera A-2 
(S38). When the ^pverv-doefgn^ indicate the selection of 
the Lock menu 401, a message corresponding to the event 
such as a change of the field angle or the like is sent 
to the camera A-2 (S39, S41 ) . When the status is 
changed, the camera sends a condition table updating 
request message of the camera to the server 17 (S42). 
The server 17 updates the camera condition table in 
accordance with the request ( S43 ) . When the 
authorization to control is released, the color of the 
title bar 312 of the display window of the camera A-2 
of the terminal B is changed to the non-selection state 
(S44), The display of the camera status display region 
314 of the title bar 312 of the display window of the 
camera A-2 other than the terminal B is released (S45). 

As described above, according to the invention, 
various settings of the camera at a remote position can 
be easily controlled by the user interface for control 
such as menu, button, or the like associated with the 
display window of the image of the camera. 

Particularly, in the panning control of the 
camera, a desired portion of the object which is 
photographed by the camera existing at a remote 
position can be seen by a method similar to that of the 
scroll of a document in a word processor or the like. 
Since the controllable attribute or variable range of 
the camera are automatically reflected to the display 



of the user interface for control such as menu or the 
like, the user can easily operate without needing to 
consider the attribute or the like of the camera at the 
time of the operation. In the camera at a remote 
position, the works for adjusting the field angle to an 
arbitrary portion of the object, for adjusting the 
focal point, for optimizing the exposure level, and for 
attaining the white balance can be executed by the 
unified user interface. 

The reduction screen image corresponding to those 
set conditions can be automatically registered and the 
registered reduction image functions as a menu when 
resetting to desired set conditions, so that the 
operation to select the resetting becomes very easy. 
By setting such that the set conditions which were set 
into a desired state cannot be changed for a 
predetermined time from another terminal, the desired 
set state can be held for a predetermined time. Both 
the name of the terminal authorized to control the 
camera and the message indicating that such a terminal 
is in use are displayed in the status display region in 
the display window of the camera at each terminal, so 
that the operator of another terminal can judge whether 
the camera is controllable or not and can also easily 
judge to which terminal the authorization to control 
should be requested. 



